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^ ' Abstract 

^. 

We prove that every free metabelian non-cyclic group has a finitely generated 

isolated subgroup which is not separable in the class of nilpotent groups. 

As a corollary we prove that for every prime number p an arbitrary free metabelian 

^ I non-cyclic group has a finitely generated p'-isolated subgroup which is not p- 

j^ ■ separable. 

^ ! Mathematics Subject Classification: 20F16, 20F14, 20F10 

^ I Key words and phrases: free metabelian group, nilpotent group, isolated subgroup, 

2 ' p-separable subgroup, Magnus representation. 

o 

r-| ■ Following A. I. Mal'cev [1] we say that a subgroup if of a group G is separable in a 

j^ ! class of groups /C, if for each g E G\ H there is a hoinomorphism ip oi G to some group 

from /C such that ip{g) ^ ^p{H). If /C is the class of all finite groups (resp. finite ]9-groups), 
the corresponding notion of /C-separability is called the finite separability (resp. finite p- 
separability). The problem of finite separability is closely related to the generalized word 
problem [1]. (The generalized word problem for H in G asks for an algorithm that decides 



X 

H , 
. yr , whether or not the elements of G lie in H. 

Let p be a prime number. Recall that a subgroup H of G is called p'-isolated, if 
for every prime q ^ p and for every g E G the condition g'^ E H implies that g E H. 
E. D. Loginova [2, § 3] proved that in each finitely generated nilpotent group every p'- 
isolated subgroup is p-separable. 

D. I. Moldavanskii suggested that the latter fact is true in every free group. 

Problem ([3, Problem 15.60]). Is it true that any finitely generated p' -isolated sub- 
group of a free group is separable in the class of finite p- groups? It is easy to see that this 
is true for cyclic subgroups. 

The paper [4] gives the negative answer to Moldavanskii's problem. More precisely, it 
is proved there that in each non-abelian free group F there is an isolated (and therefore a 
p'-isolated) finitely generated subgroup which is not p-separable. In particular, the result 
by E. D. Loginova cannot be generalized to the class of absolute free groups. 

In the present article we shall demonstrate that the result by E. D. Loginova cannot 
be generalized to the class of soluble erouns, too. We nrove the following theorem. 



Theorem. Every free metahelian non-cyclic group contains a finitely generated iso- 
lated subgroup which is not separable in the class of nilpotent groups. 

Since every finite p-group is nilpotent [5, p. 162], and every isolated subgroup is 
p'-isolated for each prime p, our theorem implies 

Corollary. Every free metabelian non-cyclic group contains a finitely generated p'- 
isolated subgroup which is not p-separable. 

§ 1. The Magnus representation of free metabelian groups 

Let F denote a free group of rank n and F" the second commutator subgroup of F. 
Then $ = FjF" is a free metabelian group of rank n. W. Magnus [6, Chapter I, § 4] 
constructed a faithful 2x2 matrix representation of $. S. Bachmuth [7] studied the 
properties of the Magnus representation. For the reader's convenience we reproduce some 
properties of the Magnus representation. 

Let $ be freely generated by xi, 0:2, • • • , a:„. Let si, S2, . . . , s„, ti,t2, ■ . ■ ,tn be commut- 
ing indeterminates. Then $ has a faithful representation by 2 x 2 matrices defined via 
the correspondence 

fsi ti\ • _ -I 9 

fj, . Xi > i„ _. I, i i, z,, . . . ,n. 

Let c = s{^sf • • • -^n") where ji, J2, ■ ■ ■ ,jn are arbitrary integers. Suppose that 

71, 72, • • • , 7n e Z[sf\ 4\ • • • , 4^]- 

Then the matrix 

/ "^ 

i=l 

^0 1 
is in the image of /i, or, equivalently, it is a product of matrices 

1 
provided that the 7j satisfy the identity 

n 
^%{1-Si) = 1-c 
i=i 

and vice versa (see [7, Lemma 1]). 

§ 2. Proof of the Theorem 

Let $ be a free metabelian group with free generators 

X, V, Zi a E I). 



where / is some index set (possibly empty). Let H he a subgroup of $ generated by the 
elements 

a = x[y,x], b = y, Zj (j G J), 

where [y, x] = y~^x~^yx and J is a subset of /. 

We claim that iJ is a proper subgroup of $ and, in particular, the element x is not in 
H. To do this let us consider a map r from $ to the symmetric group 5*3 defined via 




T : 

a iel. 

Since S^ is a metabelian group, r is a homomorphism. It is easy to see that T{a) = T{h) = 
(23), i. e., t{H) = ((23)) ~ Z2 and t{x) ^ t{H). Hence x ^ H, as required. 

Now let us prove that the subgroup H is not separable in the class of nilpotent groups. 
Consider the lower central series of $ 

$ = -y^<|) > -y2$ > 73$ > . . . , 

where 

7m'^= h<^,<^], i = l,2,..., 

and the set of homomorphisms 

(^„ : $ — >$/7n$, n = l,2, ..., 

to the nilpotent metabelian groups. Note that the image of x under all these homomor- 
phism is in the image of H. Indeed, it is easy to check that the subgroup generated by 
the elements 

V9„(a), (Pnib), (Pn{Zj), j e J, 

and the subgroup generated by the elements 

(fnix), (fniy), VniZj), j G J, 

are equal modulo the commutator subgroup $' = 72$. 
Then (see [8, Theorem 31.2.5]) the group 

(V9„(a), (Pnib), (PniZj) (j e J)) 

is equal to the group 

{(Pnix), (Pniy), Vn{,Zj) (j E J)) . 

Therefore ^n{x) G ipn{H) for all natural n. It then follows that H is not separable from 
element x in the class of free nilpotent groups and hence in the class of all nilpotent 
groups. 

To complete the proof of the Theorem we must prove that H is isolated in $. For the 
sake of simplicity, we consider the case when the index set / is empty, i. e., $ is generated 
bv X and v. The nroof in the seneral case is similar. 



Now consider the matrices 

where {e, /} is a base of a free module of rank 2 over the ring R = Z[a^^,/9^^]. Lemma 
1 from [7] imphes that the matrix 

1 

where ii, ^2 ^ ^, 7i, 72 ^ -R, is in /i($) if and only if 

7i(l-a)+72(l-/9) = l-«*^/9*^ 

Note that there exist an epimorphism ip : $ — > H that sends a; to a and y to 6. In this 
case we have the following diagram 

^ ^ H 

M2(Q) -^ M2(Q) 

where Q = R[e, /]. In order to define the map ip*, which makes this diagram to commu- 
tative we will find the images of generators of H under fi. Note that 



a 



-1 ^,-1, 



a'^e\ ,,_! fp-^ -p-^f 



^ -^ 1 j' ^ V 1 

which trivially implies that 

fa {2-f3-^)e + {l-a)(3-^f^ 
fxia)=X[X,Y] = 

\0 1 

/x(6) = Y. 
Write A for /i(a) and B for /i(&). We construct the homomorphism ifj* via 

^*(x) = A, v^*(r) = B. 

It is clear that the homomorphism A of free module M defined as follows 

e^(2-/3-i)e+(l-a)r7, 



induces the homomorphism ip* : M2{Q) — > M2{Q). Then the map ip* takes a matrix 



to the matrix 

/a^i/5^2 7i(2 - p-^)e + ((1 - a)rWi + 72)/' 

r{s) = 

\ 1 

Now it is easy to see that this map is a homomorphism. 
The matrix of the endomorphism A in the base e, / is 

2-/3-1 (1 -«)/?-! 

1 

Its determinant is equal to 2 — j3~^ = {2(3 — l)/(3. Hence A is not automorphism of M 
being considered as a module over Z[q;''=i,/3''=1]. The module M can be placed into the 
vector space M over field of rational fractions Q{a, (3) with the base e, /. Now A induces 
an automorphism of M; we shall denote the said induced map by A. Hence A G Aut(M) 
does possess the inverse and 

^+W7, — 7/' 



The map A"^ induces a map ipl which sends the matrix 
to the matrix _ 



However, it is not true in general that the latter matrix belongs to the ring M2{Q). The 
following simple lemma gives a criterion when it does belong to M2{Q). 

Lemma 1. The matrix S G yu($) belongs to the subgroup fJ.{H) if and only if ipl^S) G 

Let us return back to the proof of the Theorem. Consider the matrix S in M2((5)n/x($). 
By Bachmuth's lemma above, the following equality 

7i(l-a)+72(l-/3) = l-c, 

where c = q;*^/?*^ is true. Assume that S*™ G ^{H) for some positive integer m. 
The following lemma is obvious. 
Lemma 2. For every natural m and every matrix 



s={l -•^'X-'A^KUQ), 



where c = a*i/9*2 Jqj^ some ii,i2 G Z, the following formulas are true 


/c- (i + c+... + c™-i)(7ie + 72/)\ 


3"" = 


\0 1 J 


(c-^ -(c-i + c-2 + . . . + c— )(7ie + 72/)\ 


g-m^ 


V 1 ; 


By Lemma 2 matrix S*™" is equal to 


/c- (1 + C+... + C— i)(7ie + 72/)\ 


^m^ 


Vo 1 y 


Then by Lemma 1 the matrix 


i,i{3n = 


V2/^- 1 V 2/:/- 1 J J 




yo 1 / 



is in M2{Q). However, it is possible only in the case when (1 + c + . . . + c™~"'^)7i/9 is a 
multiple of 2/3 — 1. Note that the polynomials 13 and 2/9 — 1 are relatively prime and 
hence the polynomial 1 + c + . . . + c™""^ is relatively prime with 2(3 — \. Indeed, our first 
statement is evident while the second one follows from the fact that c™""^ = (a*!/?*^)'""^ 
and hence cannot be a multiple of 2. Therefore, 71 is a multiple of 2/3 — 1; but this means 
that ipl{3) G M2{Q). We are going to show that 1^1(3) G Ai($); then in view of Lemma 
1 this will mean that 3 G /i(-f^)- 

Consider the matrix 



rds) 



C :r-^ re + ( —77^ ^ + 72 / 



2/? - 1 V 2/3 - 1 

VO 1 

By Bachmuth's lemma, this matrix is in /i($) provided that 
71/^ /1 „A , /'7i(a- 1) 



/ 



1-a + 



+ 72 (l-/5) = l-c. 



2/3 - 1 ' ' V 2/3 - 1 

It is easy to check that this equality is equivalent to 

7i(l - a)(2/3 - 1) + 72(1 - /9)(2/3 - 1) = (1 - c)(2/3 - 1). 

This implies that 

7i(l-a)+72(l-/3) = l-c. 

Since 3 G uf^). it follows that the latter eaualitv is true. 



The Theorem is proven. 
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